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(54) IMAGE PICKUP DEVICE 
(57)Abstract: 

PURPOSE: To provide the image pickup device which can reduce the number of 
hardware and can simplify the tuning of coefficient decision. 

CONSTITUTION: When a video signal outputted from an imaging device is separated 
into a luminance signal and a chrominance signal by a Y/C separator and these signals 
are synchronized by a synchronizing circuit and inputted as signals YL\ CR' and CB\ a 
matrix operation circuit 116 directly generates color difference signals R-Y and B-Y 
without interposing RGB signals, namely, without temporarily generating the RGB 
signals based on the signals YL\ CR' and CB' and generating the color difference 
signals R-Y and B-Y based on those signals YL', CR' and CB'. 



* NOTICES * 



JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect 
the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]Separating mechanism which divides into a luminance signal and two or more 
chrominance signals a video signal outputted from an image sensor. 
A synchronization means which carries out synchronization of a luminance signal 
separated by this separating mechanism, and two or more chrominance signals. 
A matrix operation means to have been the imaging device provided with the above 
and to perform ****** BE ********** for a color-difference signal directly based on 
a signal by which synchronization was carried out by said synchronization means 
without passing a RGB code was formed. 

[Claim 2]The imaging device according to claim 1 forming a gamma correction means 
to perform a gamma correction to a color-difference signal generated by said matrix 
operation means. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application]This invention relates to the imaging device which processes 

from an image sensor to a video signal, and obtains a video output. 

[0002] 

[Description of the Prior Art]As shown in drawing 8 , in the conventional imaging 
device the video signal of the analog from the image sensor 601, A correlation double 
sampling is carried out by the correlated double sampling circuit 602, and automatic 
gain control is made in the automatic-gain-control circuit 603, and an AD translation 
is carried out by A/D converter 604, and it becomes a digital signal. And it is 
separated into the luminance signal Y and the chrominance signal C by the Y/C 



eliminator 605, and the low pass filter 606 performs career removal and amendment of 
the light filter characteristic. 

[0003] And the zone of the luminance signal Y is narrowed with the low pass filter 607, 
and the luminance signal Ys used for high-intensity color oppression is generated. By 
the contour detection circuit 608, a contour signal is detected from the luminance 
signal Y from the low pass filter 606, and edge enhancement is performed by adding 
with the luminance signal Y with the adding machine 609. To the luminance signal Y by 
which edge enhancement was carried out, a gamma correction is performed in the 
gamma correction circuit 610, luminosity oppression of a high saturation part is 
performed in the high saturation part luminosity suppressing circuit 611, and blanking 
processing is performed in the blanking additional circuit 612. And it becomes an 
output luminance signal of an analog by carrying out a DA translation with DA 
converter 613. 

[0004]On the other hand, to the chrominance signal C, synchronization of the signal 
component Wr read from said image sensor in an order like drawing 2 , Gb, Gr, and the 
Wb is carried out by the synchronization circuit 614, [Equation 1] 
An operation is performed. These signals YL, CR, and CB oppress the career by which 
it is generated by next point sequentiaHzation with the low pass filter 615. 
[0005]Next, the matrix operation circuit 616, [Equation 2] 

fin fl al b lYlL' *\ 

G = 1 a 2 b 2 8 CR' 
LbJ Ll a 3 b 3JLCB' J 

Becoming matrix operation is performed and the RGB code formed into the dot order 
next is generated, the multiplier 617 — R'=G1R, G -G2G, and B ,= G3B — it calculates 
by time sharing and a white balance is taken. 

[0006]Next, a gamma correction is performed in the gamma correction circuit 618, and 
the low pass filter 619 performs generation of color-difference-signal R-Y and B-Y in 
interpolation processing, RGB synchronization processing, and the matrix operation 
circuit 620. At this time, it is in the matrix operation circuit 620, [Equation 3] 
r-Y=R-(0.3R+0.59G+0.1 1 B) 
B-Y=B-(0.3R+0.59G+0.1 1 B) 

****** is performed. To these color-difference-signals R-Y and B-Y, it is linear 
matrix arithmetic by the hue correction circuit 621. [Equation 4] 

f (R-Y) o u O = fl elY (R-Y) i 
I (B-Y) outj = Le2 lX(B-Y) i nj 

The hue boiled and depended is amended. And about color-difference-signal R-Y and 
B-Y by which hue amendment was carried out, high-intensity color oppression is 
performed in the high-intensity color suppressing circuit 622, and abnormal conditions 
and burst addition are performed in the modulation circuit 623. And it changes into an 



analog signal with DA converter 624, and outputs as the output chrominance signal C. 
[0007] 

[Problem(s) to be Solved by the Invention]however, the middle of chrominance-signal 
processing in such a conventional system — once — a dot order — generating next 
RGB code — the dot order — in order to perform a gamma correction to next RGB 
code, necessity of many processings, such as processing matrix operation, 
multiplication, etc. before and after a gamma correction, was carried out. As a result, 
hard quantity increased, and since there were many parameters, there was a problem 
that the tuning in the case of the coefficient determination of a multiplier became 
complicated. 

[0008]In order to form three kinds of chrominance signals of RGB into the dot order 
next, the sampling rate to each color component is set to one third. For this reason, 
since a career stands on a career (refer to drawing 9 (a)) 1/3 time the frequency of 
the method before it as shown in drawing 9 (refer to drawing 9 (b)), In order to remove 
this and to prevent a clinch, the steep filter was needed in a narrow-band called zone 
MCLK/6, therefore there was a problem that the hard quantity of a filter increased. 
[0009]This invention was made under such a situation and the purpose is to provide 
the imaging device which can attain reduction of hard quantity, and simplification of 
tuning of coefficient determination. 
[0010] 

[Means for Solving the Problem]Separating mechanism which divides into a luminance 
signal and two or more chrominance signals a video signal with which this invention 
was outputted from an image sensor in order to attain the above-mentioned purpose, 
In an imaging device which has a synchronization means which carries out 
synchronization of a luminance signal separated by this separating mechanism, and 
two or more chrominance signals, a matrix operation means to perform ****** BE 
********** f or a color-difference signal directly without passing a RGB code is 
formed based on a signal by which synchronization was carried out by said 
synchronization means. 
[0011] 

[Function]Separating mechanism divides into a luminance signal and two or more 
chrominance signals the video signal outputted from the image sensor, and a 
synchronization means carries out synchronization of the luminance signal separated 
by separating mechanism, and two or more chrominance signals. 

[0012]. And a matrix operation means generates a color-difference signal directly, 
without passing a RGB code based on the signal by which synchronization was carried 
out by the synchronization means. Namely, based on the signal by which 
synchronization was carried out by the synchronization means, a RGB code is once 
generated, Based on the signal by which synchronization was carried out by the 
synchronization means, by performing ****** BE ********** for a color-difference 



signal directly, without generating a color-difference signal based on the RGB code, 
As a color-difference signal is generated by 1 time of matrix operation, using matrix 
operation for generating a RGB code as unnecessary, the number of times of the 
matrix operation in the whole system is reduced, and it enables it to attain reduction 
of hard quantity, and simplification of tuning of coefficient determination by extension. 
[0013] 

[ExamplejHereafter, the example of this invention is described in detail, referring to 
drawing 1 - drawing 7 . 

[0014]The [1st example] Drawing 1 is a block diagram showing the outline composition 
of the imaging device by the 1st example of this invention. 

This imaging device, The image sensor 101, the correlated double sampling circuit 102, 
the automatic-gain-control circuit 103, A/D converter 104, the Y/C eliminator 105, 
the low pass filter 106,107,115,119, the contour detection circuit 108, the adding 
machine 109, the gamma correction circuit 110,117, It has the high saturation part 
luminosity suppressing circuit 111, the blanking additional circuit 112, D/A converter 
113,121, the synchronization circuit 114, the matrix operation circuit 116, the hue 
correction circuit 119, the high-intensity color suppressing circuit 118, and the 
modulation circuit 1 20. 

[0015]The random noise of the image sensor 101 is reduced by carrying out the 
correlation double sampling of the video signal of the analog outputted from the image 
sensor 101 in the correlated double sampling circuit 102. And automatic gain control is 
made in the automatic-gain-control circuit 103, and an AD translation is carried out 
by A/D converter 104, and it becomes a digital signal, and is separated into the 
luminance signal Y and the chrominance signal C by the Y/C eliminator 105. 
[0016]Before long, to the luminance signal Y, career removal and amendment of the 
light filter characteristic are performed by the low pass filter 106. The luminance 
signal Y with which amendment of this career removal and the light filter 
characteristic was made is supplied to the low pass filter 107, the contour detection 
circuit 108, and the adding machine 109. By narrowing the zone of the supplied 
luminance signal Y, the low pass filter 107 generates the luminance signal Ys used for 
high-intensity color oppression, and supplies it to the gamma correction circuit 1 1 7 
and the high-intensity color suppressing circuit 1 1 8. 

[0017]The contour detection circuit 108 detects the outline of a photographic subject 
based on the supplied luminance signal Y, and supplies the contour signal to the 
adding machine 109. Then, the adding machine 109 performs edge enhancement by 
adding the luminance signal Y and a contour signal. The gamma correction of this 
luminance signal Y by which edge enhancement was carried out is carried out by the 
gamma correction circuit 1 10, Luminosity oppression of a high saturation part is made 
by the high saturation part luminosity suppressing circuit 111, blanking processing is 



made by the blanking additional circuit 1 1 2, and it is changed into an analog signal with 
D/A converter 1 1 3, and is outputted as the final luminance signal Y. 
[0018]On the other hand to the chrominance signal C, synchronization of the signal 
component Wr arranged like drawing 2 , Gb, Gr, and the Wb is carried out by the 
synchronization circuit 114, matrix operation of the expression 1 explained by the 
conventional example is performed, and the signals YL, CR, and CB are generated. 
About these signals YL, CR, and CB, with the low pass filter 115, the career by which 
it is generated by next point sequentiaHzation is oppressed, and it becomes signal YL', 
CR\ and CB'. 

[0019]Next, in the matrix operation circuit 116, matrix operation generates 
color-difference-signal R-Y and B-Y which were formed into the dot order next. If 
matrix representation of the color separation in the matrix operation circuit 616 in a 
conventional example and the white balance in the multiplier 617 is carried out here, 
[Equation 5] 
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It becomes. 

[0020]The operation for generating color-difference-signal R-Y and B-Y in the matrix 
operation circuit 620, [Equation 6] 
R-Y=R-(0.3R+0.59G+0.1 1 B) 

= (0.7G1-0.59G2-0.11 G3) It becomes YL'+(0.7a1 G1-0.59a2G2-0.1 1a3 G3) 
CR'+(0.7b1G1-0.59b2G2-0.11b3 G3) CB'. 

Generally this is, [Equation 7]It can be written as R-Y=m0YL'+m1 CR'+m2CB\ Are the 
same, [Equation 8]It can be written as B-Y=nOYL'+n1CR'+n2CB\ 
[0021] And when matrix representation of the expression 7 and 8 is carried out, 
[Equation 9] 
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C B 
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It becomes. 

[0022]Since it is shown by the expression 4 as mentioned above, the linear matrix of 
the hue amendment in the hue correction circuit 621 of a conventional example is 
from this expression 4 and the above-mentioned expression 9, [Equation 10] 

f (R— Y) ou - fl elYmO ml m2l^! | 
L (B-Y) outj = Le2 lJUO nl n 2 J^£, J 



It becomes. Generally this expression 10 is, [Equation 11] 
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It can write. So, in the matrix operation circuit 116, processing which realizes 
expression 1 1 is performed and color separation, a white balance, 
color-difference-signal generation, and hue amendment are performed simultaneously. 
[0023]Namely, the detailed composition of the matrix operation circuit 116 and the 
gamma correction circuit 1 1 7 has become like drawing 3 , and the multiplication 
coefficients pO and qO, p1, q1, and q2 [ p2 and ] in the expression 1 1 are set to the 
multiplier 202,203,204 of the matrix operation circuit 1 16 by time sharing, respectively. 
And color-difference-signal R-Y and B-Y which were formed into the dot order next 
are generated by adding the signals to which the multiplication of the multiplication 
coefficient was carried out to signal YL\ CR 1 , and CB' by the multiplier 205,206. 
[0024]Thus, based on signal YL\ CR', and CB\ a RGB code is once generated, Since 
direct color-difference-signal R-Y and B-Y are generated based on signal YU by 
which synchronization was carried out, CR', and CB\ without generating 
color-difference-signal R-Y and B-Y based on the RGB code, The matrix operation 
circuit for generating a RGB code becomes unnecessary, and the number of the part 
and matrix operation circuits will be reduced. 

[0025]The gamma correction circuit 117 performs a gamma correction to these 
color-difference-signals R-Y and B-Y. That is, the gamma correction circuit 1 1 7 has 
the differentiation characteristic generation circuit 208, the clipping circuit 209, and 
the multiplier 210, as shown in drawing 3 , and the luminance signal Ys of a 
narrow-band used for high-intensity color oppression receives the input X by the 
differentiation characteristic generation circuit 208, [Equation 12] 



Processing which obtains ****** is performed. It may be made for the differentiation 
characteristic generation circuit 208 to obtain an output like the expression 1 2 by any 
of a ROM table and hardware processing. 

[0026]And by the clipping circuit 209, as shown in drawing 4 , the output signal shown 
with the expression 12 outputted from the differentiation characteristic generation 
circuit 208 is clipped at the maximum a and the minimum b. And the multiplication of 
point sequential-ized color-difference-signal R-Y or B-Y is carried out to the clipped 
signal with the multiplier 210. As a result, color-difference-signal R-Y and B-Y 
receive the gamma correction of the full-range input d like y=f(x) of drawing 4 , and the 
full-range output c. 

[0027]If it returns to explanation of drawing 1 again, as for color-difference-signal 
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R-Y and B-Y by which the gamma correction was carried out in the gamma correction 
circuit 1 1 7, high-intensity color oppression will be made by the high-intensity color 
suppressing circuit 1 1 8 based on the luminance signal Ys. And interpolation of a pixel 
and synchronization are performed by the low pass filter 1 1 9, abnormal conditions and 
burst addition are performed by the modulation circuit 120, and it is changed into an 
analog signal by D/A converter 121, and is outputted as the output chrominance 
signal C. 

[0028]Thus, by 1 time of matrix operation generating color-difference-signal R-Y and 
B-Y, and performing a gamma correction to these color-difference-signals R-Y and 
B-Y further, after carrying out synchronization of the signal component from the 
image sensor 101, An operation amount and a parameter are reduced and reduction of 
hard quantity and simplification of tuning of coefficient determination are attained. 
[0029]Since a career is located on the place of 1/2 of the system clock MCLK as 
shown in drawing 5 in order to form two color-difference-signal R-Y and B-Y into the 
dot order next, what is necessary is just to remove this, and a zone is set to MCLK/4 
even if it takes a clinch into consideration. As a result, the zone of a career 
oppression filter will be 3/2 [ conventional ], and does not need a conventionally steep 
filter, but it also becomes possible to reduce the hard quantity of a career oppression 
filter, and the complicatedness of a design of that filter. 

[0030]The [2nd example] Next, the 2nd example is described based on drawing 6 and 7. 
This 2nd example and the 1st example of the above are different in the 2nd example to 
performing "3 Color processing" which carries out synchronization in the 1st example 
and generates the signals YL, CR, and CB in that "4 color processing" which carries 
out synchronization of the signal component Wr, Gb, Gr, and the Wb is performed. 
[0031]That is, the synchronization circuit 414 shown in drawing 6 is carrying out 
synchronization of the signal component Wr outputted from the Y/C eliminator 105, 
Gb, Gr, and the Wb as it is. these signal components Wr by which synchronization was 
carried out, Gb, Gr, and Wb — the low pass filter 415 — a next dot order — 
oppressing the career by which it is generated by next-izing, the matrix operation 
circuit 416 performs matrix operation for color-difference-signal generation etc. 
based on signal-component Wr which oppressed the career, Gb\ Gr, and Wb\ 
[0032]If matrix representation of generation of RGB in 4 conventional color 
processings and the white balance is carried out here, [Equation 1 3] 

lO = fGl 0 OYall al2 al3 al4^ wr 
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It becomes. 

[0033]The operation for generating color-difference-signal R-Y and B-Y [Equation 
14] 



r-Y=FH0.3R+0.59G+0.1 1 B) 

= (0.7G1a11-0.59G2a21-0.11 G3 a31) Wr'+(0.7G1a12-0.59G2a22-0.1 1 G3 a32) 
Gb'+(0.7G1a13-0.59G2a23-0.11 G3 a33) Gr+. (0.7G1a14-0.59G2a24-0.1 1 G3 a34) It 
can be written as Gb'. This,[Equation 15] 

It can be written as R"Y=mOWr'+m1Gb'+m2Gr , +m3Wb^ Are the same,[Equation 16] 
It can be written as B-Y=nOWr'+n1 Gb'+n2Gr'+n3Wb'. If matrix representation of the 
expression 1 5 and 1 6 is carried out, [Equation 1 7] 

(Wr' ' 

R — Y"l = fmO ml m2 m8l Gb' 
B-YJ = LnO nl n2 n3j Gr' 

IWb' 



It becomes. 

[0034]If it doubles with this expression 17 and the linear matrix of the hue amendment 
explained by the conventional example, [Equation 1 8] 

fWr' % 

elYmO ml m2 m3"| Gb' 
2 lJU0 nl n2 n8j Gr' 
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It becomes. Generally this expression 18 is, [Equation 19] 
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It can write. 

[0035]So, in the matrix operation circuit 416, color separation, a white balance, 
color-difference-signal generation, and hue amendment are simultaneously performed 
by performing processing which realizes expression 18. 

[0036] Drawing 7 is a figure showing the detailed composition of the matrix operation 
circuit 416. 

The multiplication coefficients pO and qO, pi, q1, p2 and q2, and q3 [ p3 and ] in the 
expression 18 are set to the multiplier 502,503,504,505 of the matrix operation circuit 
416 by time sharing, respectively. 

And color-difference-signal R-Y and B-Y which were formed into the dot order next 
are generated by adding the signals to which the multiplication of the multiplication 
coefficient was carried out to signal Wr, Gb\ Gr', and Wb' by the multiplier 
502,503,504,505 with the adding machine 506,507,508. 

[0037]Since other components of the 2nd example shown in drawing 6 have the 
completely same function as the 1 st example shown in drawing 1 , the explanation is 



omitted, but it cannot be overemphasized that the same effect as the 1st example is 

acquired also in the 2nd example. 

[0038] 

[Effect of the Invention]Since color-difference-signal R-Y and B-Y which were 
formed into the dot order next by 1 time of matrix operation in this invention from the 
signal by which synchronization was carried out were generated and the gamma 
correction has been performed to these color-difference-signals R-Y and B-Y, A 
hard quantity required for data processing is reduced, tuning of coefficient 
determination is simplified and the complicatedness of the hard quantity of the filter 
for career oppression by which it is further generated by point sequentiaHzation, and 
its design can be reduced now. 
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[Brief Description of the Drawings] 

[Drawing 1] It is a block diagram showing the outline composition of the imaging device 
by the 1 st example of this invention. 

[Drawing 2] It is a plot plan of the signal by which synchronization is carried out. 
[Drawing 3] It is a block diagram showing the matrix operation circuit in the 1st 
example. 

[Drawing 4] It is an explanatory view for explaining a gamma correction. 
[Drawing 5] It is an explanatory view for explaining career generating and control. 
[Drawing 6] It is a block diagram showing the outline composition of the imaging device 
by the 2nd example of this invention. 

[Drawing 7] It is a block diagram showing the matrix operation circuit in the 2nd 
example. 

[Drawing 8] It is a block diagram showing the outline composition of the conventional 
imaging device. 

[Drawing 9] It is an explanatory view for explaining the problem about the conventional 

career generating and control. 

[Description of Notations] 

101 — Image sensor 

1 14 T 414 — Synchronization circuit 

1 1 5.41 5 — Low pass filter 

117 — Gamma correction circuit 

116.416 — Matrix operation circuit 
117 — Gamma correction circuit 
202-204,502-505 — Multiplier 



206-207,506-507 — Adding machine 

208 — Differentiation characteristic generation circuit 

209 — Clipping circuit 
MCLK — System clock 



